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Abstract. In this paper we study a new approach to classify mathematical theorems 
according to their computational content. Basically, we are asking the question which the- 
orems can be continuously or computably transferred into each other? For this purpose 
theorems are considered via their realizers which are operations with certain input and 
output data. The technical tool to express continuous or computable relations between 
such operations is Weihrauch reducibility and the partially ordered degree structure in- 
duced by it. We have identified certain choice principles such as co-finite choice, discrete 
choice, interval choice, compact choice and closed choice, which are cornerstones among 
Weihrauch degrees and it turns out that certain core theorems in analysis can be classified 
naturally in this structure. In particular, we study theorems such as the Intermediate 
Value Theorem, the Baire Category Theorem, the Banach Inverse Mapping Theorem, the 
Closed Graph Theorem and the Uniform Boundedness Theorem. We also explore how ex- 
isting classifications of the Hahn-Banach Theorem and Weak Kdnig's Lemma fit into this 
picture. Well-known omniscience principles from constructive mathematics such as LPO 
and LLPO can also naturally be considered as Weihrauch degrees and they play an impor- 
tant role in our classification. Based on this we compare the results of our classification 
with existing classifications in constructive and reverse mathematics and we claim that in 
a certain sense our classification is finer and sheds some new light on the computational 
content of the respective theorems. Our classification scheme does not require any par- 
ticular logical framework or axiomatic setting, but it can be carried out in the framework 
of classical mathematics using tools of topology, computability theory and computable 
analysis. We develop a number of separation techniques based on a new parallelization 
principle, on certain invariance properties of Weihrauch reducibility, on the Low Basis 
Theorem of Jockusch and Soare and based on the Baire Category Theorem. Finally, we 
present a number of metatheorems that allow to derive upper bounds for the classifica- 
tion of the Weihrauch degree of many theorems and we discuss the Brouwer Fixed Point 
Theorem as an example. 



§1. Introduction. The purpose of this paper is to propose a new approach 
to classify mathematical theorems according to their computational content and 
according to their logical complexity. 
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1.1. Realizability of theorems and Weihrauch reducibility. The basic 
idea is to interpret theorems, which are typicaUy n2-theorenis of the form 

(Vx G X){3y e Y){x,y) e A, 

as operations F X ^Y^x ^-^ {y : {x,y) ^ A\ that map certain input data 
X into certain output data Y . In other words, we are representing theorems by 
their reahzers or multi- valued Skolem functions, which is a very natural approach 
for many typical theorems. For instance, the Intermediate Value Theorem states 
that 

(V/ G C[0, 1], /(O) ■ /(I) < 0){3x e [0, \])f{x) = 

and hence it is natural to consider the partial multi- valued operation 

IVT :C C[0, 1] ^ [0, 1], / ^ {x G [0, 1] : f{x) = 0} 

with dom(IVT) := {/ G C[0, 1] : /(O) • /(I) < 0} as a representative of this theo- 
rem. It follows from the Intermediate Value Theorem itself that this operation is 
well-defined. The goal of our study is to understand the computational content 
of theorems like the Intermediate Value Theorem and to analyze how they com- 
pare to other theorems. In order to understand the relation of two theorems T 
and T' to each other we will ask the question whether a realizer G of T' can be 
computably or continuously transformed into a realizer F of T. In other words, 
we consider theorems as points in a space (represented by their realizers) and we 
study whether these points can be computably or continuously transferred into 
each other. This study is carried out entirely in the domain of classical logic and 
using tools from topology, computability theory and computable analysis [52]. 

In fact the technical tool to express the relation of realizers to each other 
is a reducibility that Weihrauch introduced in the 1990s in two unpublished 
papers [50, 51] and which since then has been studied by several others (see for 
instance [23, 2, 5, 36, 20, 12, 39]). Basically, the idea is to say that a single- 
valued function F is Weihrauch reducible to G, in symbols F <vv G, if there are 
computable functions H and K such that 

F ^ H {id, GK). 

Here K can be considered as an input adaption and H as an output adaption. 
The output adaption has direct access to the input, since in many cases the input 
cannot be looped through G. Here and in the following ( ) denotes suitable 
finite or infinite tupling functions. This reducibility can be extended to sets 
of functions and to multi-valued functions on represented spaces. The resulting 
structure has been studied in [12] and among other things it has been proved that 
parallclization is a closure operator for Weihrauch reducibility. To parallelize a 
multi-valued function F just means to consider 

F{po,Pi,P2, ■■■) ■■= F{po) X F(pi) X F{p2) X 

i.e. to take countably many instances of F in parallel. If / is defined on Baire 
space N^, then we sometimes compose parallclization with an infinite tupling 
function. This is convenient, but does not affect the operation in any essential 
way. The resulting parallelized partial order forms a lattice into which Turing 
and Medvedev degrees can be embedded. In Section [2] we will summarize the 
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definition of Weihrauch reducibility and some relevant results. In this paper we 
will mainly study the non-parallelized Weihrauch degrees of theorems since they 
allow a finer classification of computational properties. Nevertheless, the closure 
operator of parallelization will play an important role. 

1.2. Effective choice and boundedness principles. A characterization 
of the Weihrauch degree of theorems is typically achieved by showing that the 
degree is identical to the degree of some other known principle. We have iden- 
tified certain choice principles that turned out to be crucial cornerstones in our 
classification. We can formulate these choice principles as follows: 

• (Cf) Any non-empty co-finite set ^ C N has a member x € A. 

• (Cn) Any non-empty set A C N has a member x € A. 

• (C|~) Any proper closed interval / C [0, 1] has a member x € I. 

• (C|) Any non-empty closed interval I C [0, 1] has a member x € I. 

• (Ck) Any non-empty compact set K C [0, 1] has a member x G K. 

• (Ca) Any non-empty closed sets ACM has a member x £ A. 

• (C) Any set A C N has a characteristic function cf^ : N {0, 1}. 

By a proper closed interval, we mean an interval that has more than one point. 

We will refer to these principles as co-finite choice, discrete choice, proper interval 
choice, interval choice, compact choice, closed choice and countable choice. As 
they stand, these principles are trivially correct in classical mathematics. They 
only become interesting as soon as one considers them from an algorithmic point 
of view. Given a set A by negative information, typically by some form of 
enumeration of its complement, how difficult is it to actually find a member of 
A (or the characteristic function cf^ of A)7 It is not too hard to sec that from 
this point of view these principles are algorithmically unsolvable and they form 
some hierarchy of principles of different degree of unsolvability. If we consider 
the realizers of these choice principles in the above mentioned sense, then they 
all correspond to discontinuous operations of different degree of discontinuity. 

Often it is more convenient to consider these choice principles as bounded- 
ness principles and in particular the principles of interval choice have equivalent 
boundedness versions. The benefit of the boundedness principles is that the 
negative information about the represented set A is given explicitly in form of 
one or two bounds and indeed many problems in analysis can be reduced to 
finding such bounds. In particular, we will consider the following boundedness 
principles: 

• (Bp) For any sequence ((7„)„gN of rational numbers bounded from above, 
there exists a real number x G R with sup„gpj 5„ < x. 

• (B|^) For any two sequences {qn)nen and (r„)„gN of rational numbers such 
that sup„gf^(7„ < inf„gNr„, there exists a real number x G M. such that 
sup„eN9n < a; < inf„£Nr-„. 

• (B|) For any two sequences {qn)nen and (r„)„gN of rational numbers such 
that sup„gpjg„ < inf„gNr„, there exists a real number x £ M. such that 
sup^gfj^n <x< inf 

• (B| + ) For any two sequences {qn)neN and (r„)„gN of rational numbers such 
that sup„gj^g„ < inf„gN?'n, there exists a real number a; G M such that 
sup„gN Qn < x < inf„£N fn- We allow the case r„ = oo. 
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• (B) For any sequence {qn)neN of rational numbers bounded from above, 
there exists a real number a; e M with sup„gf>j Qn — x. 

Once again, these statements are classically correct and even trivial as they 
stand. However, finding a bound algorithmically (given the guarantee that it 
exists) is a different story and once again these principles represent operations 
of different degree of discontinuity. In Section [3] we will prove the equivalence 
of certain choice and boundedness principles and we will compare them to om- 
niscience principles. Omniscience principles have been introduced by Brouwer 
and Bishop [1, 15] as non-acceptable principles in the intuitionistic framework of 
constructive analysis. Intuitionistic reasoning does neither allow the law of the 
excluded middle {A V -^A) nor de Morgan's law -^{A A B) (-.A V -^B). If 

these laws are applied to simple existential statements in first-order arithmetic, 
i.e. statements of the form A ~ {3n £ N)P(n), then the law of excluded middle 
and de Morgan's law translate into LPO and LLPO, respectively. The abbrevi- 
ations stand for limited principle of omniscience and lesser limited principle of 
omniscience^ respectively and the principles are typically formulated as follows: 

• (LPO) For any sequence p E there exists an n e N such that p{n) = 
or p{n) ^ for all n E N. 

• (LLPO) For any sequence p G such that p{k) ^ for at most one k € N, 
it follows p(2n) = for aU n e N or p{2n -|- 1) = for all n S N. 

Once again the realizers of these statements correspond to discontinuous oper- 
ations of different degree of discontinuity [51]. Other principles that are refuted 
in constructive mathematics, such as Markov's principle have continuous realiz- 
ers and hence they are not problematic from our point of view. 

The parallelizations LPO and LLPO turned out to be particularly important 
cornerstones in our classification scheme, since LPO is a S2-complete operation 
in the effective Borel hierarchy [5], i.e. it is complete among all limit computable 
operations with respect to Weihrauch reducibility and similarly LLPO is complete 
among all weakly computable operations [20, 12]. Limit computable operations 
are exactly the effectively S2~ni6asurable operations and these are exactly those 
operations that can be computed on a Turing machine that is allowed to revise 
its output. We have defined weakly computable operations exactly by the above 
mentioned completeness property in [12]. In Section [3] we will also show how the 
choice and boundedness principles are related to the omniscience principles and 
their parallelizations. 

In Section 0] we develop a number of separation techniques to show that cer- 
tain principles are strictly stronger than others or even incomparable. These 
techniques include: 

• The Parallelization Principle that states that nothing above LPO can be re- 
ducible to anything below LLPO. This principle excludes several reductions 
between choice principles. 

• The Mind Change Principle that considers the number of mind changes 
required to compute the corresponding function on a limit machine. This 
principle helps to separate decision problems from others. 
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• The Computable Invariance Principle that considers reaUzers that map 
computable values to computable values. This principle helps to separate 
problems with non-uniform computable solutions from problems that do 
not admit such solutions. It can be combined with well-known counterex- 
amples from computable analysis, such as Specker's non-computable but 
left computable real number or Kreisel and Lacombe's co-c.e. compact set 
A C [0, 1] that contains no computable points. 

• The Low Invariance Principle that considers realizers that map computable 
values to low values. This principle can be combined, for instance, with the 
Low Basis Theorem of Jockusch and Soare. 

• The Baire Category Principle that can help to separate non-discrete oper- 
ations from discrete ones. 

We apply these separation techniques to separate all choice principles (except 
co-finite and discrete choice, which are equivalent) and omniscience principles 
from each other. Figure [T] illustrates the relation between the choice principles 
and other results discussed in this paper. 
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Figure 1. Constructive, computable and reverse mathematics 



1.3. Theorems in functional analysis. As a case study we analyze a num- 
ber of theorems from analysis and functional analysis and we classify their 
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Weihrauch degree. In particular, we will consider in Sections [SJ [SI [7] and [5] 
the following theorems: 

• (BCTq) Given a sequence (yli)^^^ of closed nowhere dense subsets of a 
complete separable metric space X, there exists a point x & X \ IJjgpj Ai 
(Baire Category Theorem). 

• (BCT) Given a sequence (Ai)igN of closed subsets of a complete separable 
metric space X with X — IJ^q there is some n G N such that An is 
somewhere dense (Baire Category Theorem). 

• (IMT) Any bijective linear bounded operator T : X ^ Y on separable 
Banach spaces X and Y has a bounded inverse T^^ : Y ^ X (Banach 
Inverse Mapping Theorem). 

• (OMT) Any surjective linear bounded operator T : X Y on separable 
Banach spaces X and Y is open, i.e. T{U) is open for any open [/ C X 
(Open Mapping Theorem). 

• (CGT) Any linear operator T : X ^Y with a closed graph(r) C AT x F is 
bounded (Closed Graph Theorem). 

• (UBT) Any sequence {Ti)i,^^ of linear bounded operators that is pointwise 
bounded, i.e. such that sup{||ria;|| : z S N} exists for all x S A, is uniformly 
bounded, i.e. sup{||ri|| : i S N} exists (Uniform Boundedness Theorem). 

• (HBT) Any bounded linear functional / : F — * M, defined on some closed 
subspace F of a Banach space X has a bounded linear extension g : X 
with the same norm \\g\ \ = ||/|| (Hahn-Banach Theorem). 

• (IVT) For any continuous function / : [0, 1] ^ M with /(O) ■ /(I) < there 
exists a a; S [0, 1] with f{x) = (Intermediate Value Theorem). 

• (BFT) Any continuous function / : [0, 1]" [0, 1]" has a fixed point x € 
[0, 1]", i.e. f{x) = X (Brouwer Fixed Point Theorem). 

• (BWT) Any sequence (a:i)igN of numbers in [0, 1]" has a convergent subse- 
quence (Bolzano- WeierstraB Theorem). 

• (WAT) For any continuous function / : [0, 1] M and any n G N there exists 
a rational polynomial p G Q[x] such that ||/— p|| — sup^-gjo ij \fix)—p{x)\ < 
2~" (Weierstrai3 Approximation Theorem). 

• (WKL) Any infinite binary tree has an infinite path (Weak Konig's Lemma). 

The Baire Category Theorem is an example of a theorem for which it matters 
which version is realized. In the formulation BCTq it leads to a continuous 
and even computable realizer, whereas the version BCT is discontinuous. The 
realizers of the given theorems are operations of different degree of discontinuity 
and our aim is classify the computational Weihrauch degree of these results. 
The benefit of such a classification is that practically all purely computability 
theoretic questions of interest about a theorem in computable analysis can be 
answered by such a classification. Typical questions are: 

1. Is the theorem uniformly computable, i.e. can we compute the output in- 
formation y £ Y uniformly from the input information x G X7 

2. Is the theorem non-uniformly computable, i.e. does there exist a computable 
output information y E Y for any computable input information x G A? 

3. If there is no uniform solution, is there a uniform computation of a certain 
effective Borel complexity? 
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4. If there is no non-uniform computable solution, is there always a non- 
uniform result of a certain arithmetical complexity or Turing degree? 

Answers to questions of this type can be derived from the classification of 
the Weihrauch degree of a theorem. In the diagram of Figure [1] we summarize 
some of our results. The arrows in the diagram are pointing into the direction of 
computations and implicit logical implications and hence in the inverse direction 
of the corresponding reductions. No arrow in the diagram can be inverted and 
no arrows can be added (except those that follow by transitivity). 

In Section [5] we provide a number of metatheorems that allow to determine 
upper bounds of the Weihrauch degree of many theorems straightforwardly, just 
because of the mere topological form of the statement. For instance, any classical 
result of the form 

with a co-c.e. closed A <Z X x Y and a co-c.e. compact Y has a realizer that is 
reducible to compact choice Ck. The table in Figure [H summarizes the topolog- 
ical types of metatheorems and the corresponding version of computability. We 

metatheorem computability unique case 

open computable computable 

compact weakly computable computable 

locally compact limit computable non-uniformly computable 

Figure 2. Types of metatheorems, choice and computability 

illustrate that these metatheorems are useful and we show that one directly gets 
upper bounds for theorems such as the Brouwer Fixed Point Theorem and the 
Peano Existence Theorem for the initial value problem of ordinary differential 
equations. 

1.4. Related approaches. Several other approaches to classify mathemati- 
cal theorems from a logical point of view have already been presented and studied 
intensively. In our context, the most relevant approaches are constructive anal- 
ysis as studied by Bishop, Bridges and Ishihara [1, 15] and many others and 
reverse mathematics as proposed by Friedman and Simpson [48] . In computable 
analysis theorems have been classified according to the Borel complexity by the 
authors of this papers and others [5, 19, 10, 20]: 

• Constructive mathematics: in constructive mathematics theorems have 
been proved to be intuitionistically equivalent to certain principles which 
are not acceptable from the constructive point of view. Such principles 
are, for instance, the Limited Principle of Omniscience LPO and the Lesser 
Limited Principle of Omniscience LLPO. 

• Reverse mathematics: in reverse mathematics theorems have been clas- 
sified according to which comprehension axioms are required to prove these 
theorems in second-order arithmetic. Such comprehension axioms are, for 
instance, the Recursive Comprehension Axiom RCAq and the Arithmetic 
Comprehension Axiom ACAq. Another system of wide importance is the 
system of Weak Konig's Lemma WKLq. 
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• Computable mathematics: in computable mathematics theorems have 
been classified according to their Borel complexity, i.e. according to the 
complexity that realizers of those theorems have in terms of effective Borel 
measurability. 

There are several further related approaches and variants of the aforemen- 
tioned ones that we cannot list here completely. We just mention intuitionistic 
reverse mathematics as studied by Ishihara [26, 27] and others and uniform re- 
verse mathematics as proposed by Kohlenbach [31, 30]. It is not too difficult to 
recognize that all these various approaches mentioned here are related in some 
form or the other, although they are expressed in terms that appear to be dif- 
ferent on the first sight and they produce different and sometimes incompatible 
results. 

We claim that our approach, which is a refinement of the third approach, sheds 
some new light on the computational status of theorems and perhaps on all the 
above approaches. In some respects, our classification scheme is finer than those 
proposed in other approaches and it distinguishes certain aspects that have not 
been captured yet. The arrows at the side in Figure [T] give some rough indication 
where results are located in other approaches. In the Conclusion we will add some 
further comments on how our approach compares to other existing ones. 

§2. Weihrauch reducibility, omniscience principles and weak com- 
putability. In this section we briefly recall some definitions and results from 
[12] on Weihrauch reducibility and omniscience principles as far as they are rel- 
evant for the present study. More details and many further results can be found 
in the aforementioned source. We assume that the reader has some basic famil- 
iarity with concepts from computable analysis and otherwise we refer the reader 
for all undefined concepts to [52]. In a first step we define Weihrauch reducibility 
for sets of functions on Baire space, as it was already considered by Weihrauch 
[50, 51]. 

Definition 2.1 (Weihrauch reducibility). Let T and Q be sets of functions 
of type / :C N^. We say that T is Weihrauch reducible to in symbols 

J- <w G, if there are computable functions H, K :C such that 

(VG G g){3F eT)F = H{id, GK). 

Analogously, we define <s\n Q using the equation F = HGK and in this case 
we say that J- is strongly Weihrauch reducible to Q. 

Here ( ) : x — > N'* denotes a computable standard pairing function 
[52] . This reducibility is derived from Weihrauch reducibility of single functions 
(which we did not formalize here) in the same way as Medvedev reducibility 
is derived from Turing reducibility in classical computability theory [43]. We 
denote the induced equivalence relations by =w and =sw, respectively. 

In the next step we define the concept of a realizer of a multi-valued function 
as it is used in computable analysis [52]. We recall that a representation 5x '-^ 
—> X of a set X is a surjective (and potentially partial) map. In general, the 
inclusion symbol "C" indicates partiality in this paper. In this situation we say 
that {X,5x) is a represented space. 
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Definition 2.2 (Realizer). Let {X, Sx) and {Y, Sy) be represented spaces and 
let / :C X ^ y be a multi- valued function. Then f :C N"*^ ^ is called 
realizer of / with respect to {6x,Sy), in symbols F h /, if 

SyF{p) g fSxip) 

for all p e doni(/5x)- 

Usually, we do not mention the representations explicitly since they will be 
clear from the context. A multi-valued fmiction / :C X ^ y on represented 
spaces is called continuous or computable, if it has a continuous or computable 
realizer, respectively. Using reducibility for sets and the concept of a realizer we 
can now define Weihrauch reducibility for multi- valued functions. 

Definition 2.3 (Realizer reducibility). Let / and g be multi- valued functions 
on represented spaces. Then / is said to be Weihrauch reducible to g, in symbols 
/<wfl, if and only if {F : F \~ f}<w{G : G h g}. Analogously, we define 
/ <sw 9 with the help of <sw on sets. 

That is, f <w g holds if any realizer of g computes some realizer of / with 

some fixed uniform translations H, K. This reducibility has already been used 
in [5] for single-valued maps and in [20] for multi-valued maps. We mention 
that we also write / <w 9 if and only if / <w 9 and g /• Moreover, we write 
/ |w 5 if / 9 and g ,/• Analogous notation is used for <sW- It is clear that 
Weihrauch reducibility and its strong version form preorders, i.e. both relations 
are reflexive and transitive. It is also clear that strong reducibility is actually 
stronger than weak reducibility in the sense that / <sW .9 implies / <w g and 
both reducibilities preserve computability and continuity from right to the left. 
By a Weihrauch degree we mean the equivalence class of all multi- valued func- 
tions on represented spaces with respect to Weihrauch reducibility, where we only 
consider functions with at least one computable point in the domain and defined 
on a certain fixed set of underlying represented spaces. Among all Weihrauch 
degrees there is a least one, namely the degree of the computable multi-valued 
functions. Weihrauch reducibility and strong Weihrauch reducibility are both 
invariant under equivalent representations, i.e. if we replace representations by 
computably equivalent ones, this does not affect the reducibility relations. 

One can show that the product of multi- valued functions / x 5 and the direct 
sum f ® g are both monotone operations with respect to strong and ordinary 
Weihrauch reducibility and hence both operations can be extended to Weihrauch 
degrees. This turns the structure of partially ordered Weihrauch degrees into a 
lower-semi lattice with the direct sum operation as greatest lower bound opera- 
tion. It tTirns out that a very important operation on this lower semi-lattice is 
parallelization, which can be understood as countably infinite product operation. 

Definition 2.4 (Parallefization) . Let f -.C X ^ Y he a, multi- valued func- 
tion. Then we define the parallelization f :C X^ ^ Y^ of / by 

^ 00 
f{xi)im ■■= X f{xt) 

1=0 

for all (a;i)ieN G 
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We mention that parallelization acts as a closure operator with respect to 

Wcihrauch rcducibility. 

Proposition 2.5 (Parallelization). Let f and g he multi-valued functions on 
represented spaces. Then 

1- f <w f (extensive) 

2- / <w .9 / <w 9 (increasing) 

3- f =w f (idempotent) 

An analogous result holds for strong Wcihrauch rcducibility. 

Hence, we can define in a natural way a parallelized version of Wcihrauch rc- 
ducibility and of Wcihrauch degrees, just by replacing equivalence classes by their 
closures. In some sense, the relation between ordinary Wcihrauch rcducibility 
and its parallelized version is similar to the relation between many-one rcducibil- 
ity and Turing rcducibility in classical computability theory. The parallelized 
Wcihrauch degrees even form a lattice with the product operations / x g as least 
upper bound operation and the direct sum as / © as greatest lower bound 
operation. We can attach a virtual greatest element to this lattice that acts like 
a multi-valued function without realizer. One can prove that Mcdvedcv degrees 
can be embedded into this lattice such that least upper bounds and greatest 
lower bounds are preserved and as a special case one obtains an embedding of 
Turing degrees. 

Very helpful cornerstones in the Wcihrauch semi-lattice are the omniscience 
principles that we already mentioned in the introduction. Formally, we consider 
them as maps. 

Definition 2.6 (Omniscience principles). We define: 

if {3n € N) p{n) = 



LPO : ^ N, LPO(p) = | J 



otherwise 



.LLP0:CN"^N.LLP0,„3{J ^ J^;; ^ ^> jg'^t . ■ 

where dom(LLPO) :— {p G : p{k) ^ for at most one fc}. 

One should notice that the definition of LLPO implies that LLPO(0") = {0, 1}. 
The following result summarizes the relations between the omniscience principles 
and their parallelizations to each other. 

Theorem 2.7 (Omniscience principles). Wc obtain 

LLPO <w LPO Iw LLPO <w LPO. 

The parallelization C := LPO of LPO is known to be S^^complete among all 
effectively Sa-measurable maps (see [5]). The effectively Sj-measurable maps 
are also called limit computable. Similarly, LLPO plays a significant role and 
it can be proved that the class of all multi-valued functions that are reducible 
to LLPO are closed under composition. An equivalent result has already been 
obtained in [20], expressed in terms of Weak Konig's Lemma. We do not mention 
the straightforward formalization of WKL as multi- valued function here, but we 
mention the result from [12]. 
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Proposition 2.8. WKL^wLLPO. 

Prom now on we will use WKL and LLPO interchangeably, depending on which 

one fits better into the context. We take the nice composition property of func- 
tions below WKL =w LLPO as a reason to call these functions weakly computable. 
This class of functions is closely related to compact choice, which we can define 
in the following generalized sense. 

Definition 2.9 (Compact choice). Let X be a computable metric space. The 
multi- valued operation 

Ccix) :C/C_(X) =4XA^ A 

with dom(CAc(x)) '■= X : A ^ (b compact} is called compact choice of X. 

Here IC-{X) denotes the set of compact subsets of X, represented by enu- 
merations of finite rational open covers (which are not necessarily minimal) (see 
[13]). It can be proved that LLPO is equivalent to compact choice for a large 
class of computable metric spaces, which has essentially been proved in [20]. 

Theorem 2.10 (Compact choice). Let X be a computable metric space. Then 
Cic(x) ^sW LLPO. // there is a computable embedding i : {0,1}^ ^ X, then 
^K{x) =sw LLPO. 

One can also prove that on computable metric spaces a multi-valued function 
is weakly computable if and only if it has an upper semi-computable compact- 
valued selector. This implies the following important result, which states that 
single-valued weakly computable functions are automatically fully computable. 

Corollary 2.11 (Weak computability) . Let X be a represented space and Y 
a computable metric space. Any weakly computable single-valued operation f :C 
X is computable. 

§3. Choice and boundedness principles. In this section we study choice 
principles and boundedness principles. Both types of principles are closely re- 
lated to each other and they are also related to the omniscience principles men- 
tioned earlier. In some sense most of the boundedness principles are just variants 
of the choice principles that are more convenient for some applications. 

By A(X) or A-{X) we denote the set of closed subsets of a metric space 
X. The index "— " indicates that we assume that the hyperspace A-{X) is 
equipped with the lower Fell topology and a corresponding negative information 
representation explained below. All choice principles are restrictions of the 
multi- valued choice map 

Choice :CA-{X)^X,A^ A, 

which is defined for non-empty closed sets A C X and maps any such set in a 
multi-valued way to the set of its members. That is, the input is a non-empty 
closed set A G A-{X) and the output is one of the (possibly many) points x € A. 
We can define restrictions of the choice map by specifying the respective domains 
and ranges. 
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Definition 3.1 (Choice principles). We define multi- valued operations as re- 
strictions of the respective choice maps as follows: 

1. Cf :C A-{N) ^ N, dom(CF) := {A C N : A co-finite}. 

2. Cn :C A-{N) ^ N, dom(CN) := {A C N : A 9}. 

3. C| :C ^_[0, 1] =1 [0,1], dom(Ci) := {[a, 6] : < a < & < 1}. 

4. Cr :C ^_[0, 1] i4 [0,1], dom(Cr) := {[a,b] : < a < 6 < 1}. 

5. Ck :C A-{[0, 1]) ^ [0, 1], dom(CK) := {if C [0, 1] : JsT ^ compact}. 

6. Ca :C A-Ir) ^ R, dom(CA) -.^ {A CR : A ^ d) closed}. 

We refer to these operations as co-finite choice, discrete choice, interval choice, 
proper interval choice, compact choice and closed choice, respectively. 

Whenever X is a computable metric space, we will use the representation ip- 
of A-{X) that represents a closed set A C X by negative information. There 
are different equivalent ways of characterizing this representation (see [13] for 
details). The intuition is that a name p of a closed set A is an enumeration of 
rational open balls B{xi,ri) that exhaust the complement of A, i.e. X\A = 
i3(xi, Tj). Here a rational open ball is a ball with center in the dense set 
and a rational radius. The ^/'--computable members in A-{X) are called co-c.e. 
closed sets. 

In the case of A- (N) we can consider ip- just as an enumeration of the com- 
plement, i.e. ijj-{p) = ^ if and only if 

N\^ = {nGN:n-|-lG range(p)} =: range(p) — 1. 

Here Ta.nge{p) — 1 is used opposed to range(p) in order to leave the sequence 0^ 

as name for N. 

For practical purposes it is often more convenient to handle these choice prin- 
ciples in form of the closely related boundedness principles that we define now. 

Definition 3.2 (Boundedness principles). We define the following multi- valued 
operations (with their maximal domains, if not stated otherwise): 

1. Bp : R< =r K, X 1-^ [x,oo). 

2. B| :C R< X R> ^ R, (x, y) ^ [x, y], dom(B|) := {{x, y) : x < y}. 

3. Br :C: R< X R> =r R, {x,y) [x,y], dom(Br) := {{x,y) : x < y}. 

4. B|+ :C R< X % R, {x, y) ^ [x, y], dom(B|+) := {{x, y) : x < y}. 

5. B : R< ^ R, a; x. 

Here we assume that R, R< and R> are equipped with the ordinary Cauchy 
representation p of the reals and the left and right representations p< and p> , 
respectively (see [52] for details). A name p e N'^ of a real number with respect 
to the representation p< is a sequence of rational numbers ((/„)„eN such that 
x = sup„gisjg„. Without loss of generality one can assume that the sequence 
is strictly increasing, whenever this is helpful. The representation p> is defined 
analogously using the infimum instead of the supremum and without loss of 
generality we can assume that the corresponding sequence is strictly decreasing, 
whenever required. The representation p = p< Fl p> is the join of p< and /9>, 
which means that it contains both types of information simultaneously. Here 
R> = R U {oo} and it is represented by the extension of /?> that represents a 
point by a decreasing sequence of numbers in Q U {oo}. The sequence that has 
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constant value oo is the only name of oo. We mention that [a, oo] is meant to be 
the set {x e R : a < a; < 00} in case of B|+ since the result is required to be an 
ordinary real number. The boundedness principle B|~ is just the restriction of 
B| to the non-degenerate case and Bi"*" is the extension of B| to the case where 
the right-hand side bound is allowed to be 00. Sometimes it is convenient to 
assume that range(BF) = N and this is possible without loss of generality since 
the operation [/ : R =| N, a; 1-^ {n € N : a; < n} is computable (see [52]). 

It is clear the the choice and the boundedness principles are closely related 
to each other and as a first result we prove that co-finite choice Cp is strongly 
equivalent to Bp. Perhaps it is surprising that both operations are equivalent 
to discrete choice Cn, however not in the strong sense since this result uses the 
direct access to the input in an essential way. 

Proposition 3.3 (Discrete choice). Bp =sw Cp =w Cn- 

Proof. Wc first show Bp <swCp. Given a bounded sequence ((7i)igN of ra- 
tional numbers we want to compute a real number x with supjgj^ qi < x. Now 
we consider the following co-finite set of natural numbers 

^ = N\{nGN: (3i) n < gj. 

Any point k ^ A satisfies k > sup^fr^ qi- Given {qi)ii=n we can generate a 
name of A and hence with the help of some realizer of Cp, we can find a point 
k G A, which is a desired upper bound. Thus Bp <sw Cp. 

We now prove Cp <sw Bp. Given a sequence p G such that the set range(p) — 
1 = N \ A is finite, we can consider p as an enumeration of rational numbers and 
since N \ A is finite it follows that maxrange(j)) exists. We can use any realizer 
of Bp to find a natural number n > maxrange(p) and any such n is in A. Thus 
Cp <sw Bp. 

It is clear that Cp <sw Cn, because the former is a restriction of the latter. 
We prove Cn <w Bp. Let p e N"*^ be a sequence such that range(p) — 1 = N \ A 
and A is non-empty. The goal is to find a number k G A. For this purpose we 
inspect the sequence p and we try to find a suitable number (whose successor is) 
not enumerated in p. Starting with the candidate c = 0, we inspect p in stages 
n = 0, 1, 2, ... and whenever the current candidate c is enumerated, i.e. whenever 
p{n) = c + 1, then we replace the current candidate by the smallest number 
which has not yet been enumerated (i.e. c = min(N\ {p(0) — 1, ...,p{n) — 1}). At 
the same time we record the stages in which we have to change our candidate 
in a sequence r, i.e. r{n) n in stages n where a new candidate c has been 
chosen and r{n) := r(n — 1) in all other stages n > 1. The sequence r is 
increasing and eventually constant, since there is a smallest missing number in 
range(p) — 1 = N \ A. In fact, this smallest number is also the smallest natural 
number, which is not among the numbers 

p(0) — l,p(l) — 1, ...,j5(maxrangc(r)) — 1. 

The function F : N'** — *■ that maps each p to the corresponding r = F(p) is 
computable and with the help of a realizer of Bp we can find a natural number 
m > maxrange(r). With direct access to the original input p it is then possible 
to inspect the numbers p(0), ...,p{m) in order to find the smallest number k gN 
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that is not among the numbers p{0) — 1, ...,p{m) — 1. This number is a suitable 
output since fc e A. Altogether, this shows Cn <w Bp- H 

We mention that discrete choice Cm has another interesting property: it is 
idempotent. This means that Cn x Cn =w Cm or, in other words, one can use one 
instance of Cn to solve two requests simultaneously. The relevance and properties 
of idempotency are discussed in [12]. 

Proposition 3.4 (Idempotency of discrete choice). Cn =w Cm x Cn- 

Proof. Since max : IR<; x K< — > M< is computable and any z G BF(max(a;, y)) 
satisfies z G BF(a;) fl Bf{y) we obtain Bp =w Bp x Bp. By the previous Proposi- 
tion [23] the same holds true for Cn- H 

Sometimes it is useful to assume that B| or B|+ are restricted to the open 
interval (0, 1) and this is possible by the following lemma. 

Lemma 3.5. The multi-valued function 

B|' :C (0, 1)< X (0, 1)> ^ (0, 1), ix,y)^{z:x<z< y}. 

is strongly equivalent to B\, i.e. B|=swB|'. Analogously, B|^ =sw B|' for the 
restriction B\' of B\' to dom(B|' ) := {{x,y) : x < y}. 

Proof. One can use the strictly monotone computable and bijective function 
/ : (0, 1) ^ M, X tan (nx - |) 

in order to identify (0, 1) with K. The inverse /^^ of / is computable as well. 
We obtain B|'(x,y) = f-\Bi{f{x),f{y))) for aU x,y e (0,1) and B|(x,2/) = 
/(B|'(/~^(x), /~^(y))) for all x,?/ G M. Since / is strictly monotone increasing, 
/ and its inverse f~^ are also (/9<,p<)- and (yO>, p>)-computable. This implies 
B| =sw B|'. Analogously, one obtains B|~ =sw B\'~ . H 

Thus, wherever it is convenient, we can assume that the range of B| and B|~ 
is (0,1). The second main observation in this section is that interval choice 
C| is strongly equivalent to B| and correspondingly proper interval choice C|~ 
is strongly equivalent to B|^. This means that in case of interval choice the 
negative information can be provided in forms of left and right hand bounds 
(as in B| and B|^) or in form of intervals that exhaust the complement without 
explicit information on which side the negative information lies (as in C| and 
C|^). We note that in case of B|+ the negative information has to be given in 
form of two separately presented bounds because the underlying space is not 
compact. 

Proposition 3.6 (Interval choice). B| =sw Q, Br =sw Cr, B|+ <sw Ca- 

Proof. We prove C| <sw B|. Let us assume that a non-empty interval / = 
[a,b] C [0, 1] is given in the form [0, 1] \ / = IJi^o "^i' "^here any Ji is an open 
interval in [0, 1] given by its rational endpoints, possibly containing the points 
or 1. We use this sequence ( Ji)igN to generate two sequences of real numbers 
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{qi)ieN and (ri)igN- We choose 

r sup(L) iiL = {xeR:[0, x] C Ur=o '^J ^ ^ 
^" ■ \ otherwise 




inf(C/) if C/ = {yeM: CU:U -^0 7^0 
1 otherwise 



Then sup„gpj g„ — a and inrngN?"?! = b because [0, 1] \ (a, 6) is compact. Thus, 
given a realizer of B|, we can compute a real number y e B|(a, 6), i.e. a < y < b. 
This shows C| <sw B|. 

For the other direction we consider the boundedness principle B|', which is B| 
restricted to the open interval (0, 1), which is strongly equivalent to B| according 
to Lemma [3.51 We prove B|'<swC|. Given sequences {qi)i,=ti and (ri)igN of 
rational numbers such that a := snp^fz^qt < infigN?'i —■ b with a,b €z (0, 1), we 
want to find a point x with a < a; < 6. Now we compute a sequence {Ji)ieN of 
rational intervals that are open in [0, 1] by 

J2i := [0,qt),J2i+i (^,1] 

and we obtain the interval / — [a,b] — [0,1] \ [J°°^q Ji- With the help of a 
realizer of C|, we can find a point x € I, i.e. such that a < x < b. This shows 
B| =sw B|' <sW C|.Thc same proof shows B|~ =sw C|~. 

The reduction B|+<s-vvCa can be proved analogously B|'<swCi using the 
intervals 

J2i ■■= {-00,qi),J2i+l ■■= (ri,CX)), 

where (oo, oo) — H 

We recall that it is known that B is equivalent to C = LPO. The map C 
can be considered as countable closed choice and it is equivalent to the map 
^_(N)^{0,l}N,^^cf^. 

Proposition 3.7 (Countable closed choice). BswC=w LPO. 

Proof. It is well known that translating a /9<-name of a real number into 
a p-name is equivalent to C, this has originally been proved in [50] (see also 
Exercise 8.2.12 in [52]). Since C = LPO this means B =w LPO. H 

Now we will show that proper interval choice is reducible to discrete choice. 
This might be surprising on the first sight and indeed one does not get strict 
reducibility but one has to exploit direct access to the input in an essential way 
for this reduction, similarly to the proof of the reduction Cp <w Cn in Proposi- 
tion [331 

Proposition 3.8 (Proper interval and discrete choice). C|^ <w Cn- 

Proof. We have Cn =w Bp by Proposition 13.31 and B|^ =sw by Proposi- 
tion [3?6l Thus it suffices to prove B|^ <w Bp. Given a name p that encodes an 
increasing sequence {qn)neti of rational numbers and a decreasing sequence of 
rational numbers (r„)„gN with x := sup„gpj(7„ < inf„gN?'n =: y we want to find 
a point z g M with x < z < y. We inspect the sequences of rational numbers for 
indexes n = 0, 1, 2.... At stage we '"guess" that the center cq := qo + is a 

good choice for a point z. If at stage n we have some current choice c, then we 
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check whether this choice is supported in this stage. If (7„ > c or r„ < c, then 
we dismiss the current guess c and replace it by the new guess c„ :=(?„+ ''"2^" , 
the center of [(7n,r„]. We record those stages n where we have to dismiss the 
guess in a sequence r, starting with r(0) = 0. In those stages where we do not 
have to dismiss the guess, we just repeat the number of the previous stage that 
was dismissive in r. Ahogether, this describes a computation of a function K 
with K{p) ~ r. Since a: < y, it is clear that the sequence r of rational num- 
bers is bounded. Using a realizcr of Bp wc obtain a corresponding upper bound 
m > max range(r) . Using this bound m and the original input p, we can repeat 
the computation of guesses of centers starting with cq until stage m. We then use 
the current guess c at stage m as final choice. The upper bound m guarantees 
that this choice z — c will never be dismissed in the future and hence satisfies 
X < z < y. Altogether, this describes how B|~ can be reduced to Bp. H 

We note that in the end of the proof it is necessary to repeat the whole 
computation until stage m and we cannot simply choose the center that is reached 
at stage m. This is because the center of stage m is not necessarily better than 
the previous centers at some stage k < m. Figure [3] illustrates the situation (the 
center c of stage survives stage m + 1 but the center of stage m would not 
survive). 

ro 

H Stage 

Stage m 

Stage m + 1 



90 



qm 



qm + 1 Tm + l 



Figure 3. Centers of stages 0, m, m + 1 

Now we prove that LLPO can be reduced to proper interval choice C|^ and 
LPO can be reduced to discrete choice Cn. 

Proposition 3.9 (Omniscience and choice). LLPO<wCr, LPO<wCn- 

Proof. By Propositions 13.31 and 13.61 it suffices to prove the two reductions 
LPO <w Bp and LLPO <w Br. We prove that LPO <w Bp holds. For this pur- 
pose we consider a computable function / : — > K<,p 1-^ Xp, where 

min{n G N : p{n) ^0} ii p 0^ 
otherwise 

Then we obtain for all p 0^ 

y e Bf{xp) -^=^ Xp<y {3n < y) p{n) ^ 0. 

Thus, any realizer of Bp can be used to compute a realizcr of LPO, since the 
realizer of Bp yields a "search modulus" y that one can use to determine a suitable 
value for LPO with direct access to p. More precisely, for every y £ Bp(a;p) we 
obtain 

p^(f ^ p[y + i]= p{Q)...p{y) ^ oy+\ 
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This means LPO <w Bp. 

We prove LLPO<wB|~. Given a sequence p S N'*^ that is different from 
in at most one position we search for such a position. As long as = for 
71 = 0, 1, 2, , we generate two sequences of values <?„ = —2^" and r„ = 1 + 2^". 
As soon as we find a value n with p(n) ^ 0, we continue differently. If n is even, 
then we continue with the values = 1/4 + 2'^ for all k > n, whereas the 
qk are left as described above. If n is odd, then we continue with the values 
qk = 3/4 — 2"*^ for k > n, whereas the values for are left as described 
originally. Let x := sup„gfjg„ and y := inf„gN?'n- Now we obtain 

( [0,1] ifp(n) = for all n 
[x, y] = \ [0, 1/4] if p(2n) ^ for some n 

[ [3/4, 1] if p{2n + 1) 7^ for some n 

Given any realizer of B|^, we can now determine a value z S B\~{x,y) = [x,y]. 
Then we check whether z G (1/4,1] or z € [0,3/4) and depending which test 
gives a positive result first, we produce the output m = or to = 1. In any case 
TO G LLPO(p). Thus LLPO<sW The construction of intervals is illustrated 
in Figure m H 



Figure 4. Interval construction for LLPO 



If we compile all the observations of this section then we obtain the following 
main result. In fact, we have identified two chains of choice principles that are 
related in the given way. This clarifies all the positive relations between the 
corresponding operations given in Figure [TJ 

Theorem 3.10 (Choice chains). We obtain 

1. LLPO <w Cr <wC| <wCk=w LLPO <wCa. 

2. LPO <w Cn <w B|+ <w Ca <w C =w LPO- 

3. LLPO <w LPO, Cr <w Cn, C| <w B| + . 

Proof. We recall that C = LPO, Ck =w LLPO by Theorem [^1131 and by 
Theorem 12.71 we obtain LLPO <w LPO. The reduction Ca <w C since Ca is S^" 
computable by Proposition 4.5 of [10] and C is known to be Sj-complete [5]. By 
Proposition 13.81 we have C|~ <w Cn and by Proposition 13.61 we have Bi"*" <w Ca- 
By Proposition 13 . 91 we have LLPO <w C|~ and LPO <w Cn- 

It is clear that C|^ <w C| <w Ck <w Ca since each operation in this chain 
is a restriction of the next one. Similarly, B| <wB|"'' since B| is a restriction 
of Bi"*" and Bf<wB|"'" since Bf{x) = B|"'"(x, cxd), which implies C| <wB|^ and 
Cn <w B|+ by Propositions 13.61 and 13.31 H 

In the next section we will see that all the given reductions are strict (besides 
those cases where we have stated equivalence). 
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Theorem 12.71 and the fact that paraUehzation is a closure operator by Propo- 
sition 12.51 allow us to conclude that the parallelized version of our choice prin- 
ciples are all either equivalent to LLPO or to LPO (which are in the relation 
LLPO <w LPO to each other). 

Corollary 3.11 (Countable choice principles). We obtain the following two 
equivalence classes: LLPO =w =w C| =w Ck <w LPO =w Cn =w Ca- 



§4. Separation techniques. In this section we discuss a number of sep- 
aration techniques for Weihrauch degrees. These techniques include the Par- 
aUehzation Principle, the Mind Change Principle, the Computable Invariance 
Principle, the Low Invariance Principle and the Baire Category Principle. The 
Mind Change Principle, the Computable and the Low Invariance Principle are all 
instances of a more general Invariance Principle. The idea is basically to identify 
a property of realizers that is preserved downwards by Weihrauch reducibility 
and that distinguishes the two degrees that are to be separated. 

The first technique that we mention is the paraUehzation principle. It is a 
straightforward consequence of Theorem 12.71 on the omniscience principles and 
the fact that paraUehzation is a closure operator. 

Lemma 4.1 (ParaUehzation principle). If f -.C X is such that LPO <w / 
and g :C U ^ V is such that g <w LLPO, then f <?• 

Proof. Let LPO<vv/ and g LLPO. Let us assume that /<w5 holds. 
Since paraUehzation is a closure operator by Proposition 12 . 51 we obtain 

LP0<w/<w5<wLLP0 
in contradiction to Theorem 12.71 H 

As an example of an application of the paraUehzation principle we mention 
that it implies that co-finite choice Cp, discrete choice Cn and closed choice Ca 
are all not reducible to compact choice Ck. 

Corollary 4.2. Cn =w Cp Ck and Ca Ck- 

Several other negative results such as B|+ C| follow in the same way, but 
we do not give a complete list. Now we want to consider the Invariance Principles 
and as a preparation we define computations with mind changefl 

Definition 4.3 (Mind changes). Let n e N. We say that a function F :C 
— > is computable with at most n mind changes, if there is a limit Turing 
machine such that for a given input p the machine produces output Fij)) in the 
long run with a two-way output, but such that the machine moves the head on 
the output tape backwards at most n many times (but each time for an arbitrary 
finite number of positions) and otherwise the machine operates under one-way 
output conditions. 



^The concept of mind changes seems to be related to the concept of a topological level of a 
function, as studied by Hertling [23] and Pauly [39]. 
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In fact, those functions that can be computed with mind changes are exactly 
the computable functions. Now we can combine all our Invariance Principles in 
a single result. We recall that a point p e N'*' is called low, if p' <t 0' (we can 
identify p with graph(p) for all purposes regarding jumps and Turing reducibil- 

ity). 

Lemma 4.4 (Invariance Principles). Let X,Y,U and V be represented spaces 
and let f :C X ^ Y and g :C U V be multi-valued functions such that 
f <w 9- Let n e N. 

1. (Mind Change Principle) If g has a realizer that can be computed with at 
most n mind changes, then f has a realizer that can be computed with at 
most n mind changes. 

2. (Computable Invariance Principle) If g has a realizer that maps computable 
inputs to computable outputs, then f has a realizer that maps computable 
inputs to computable outputs. 

3. (Low Invariance Principle) If g has a realizer that maps computable inputs 
to low outputs, then f has a realizer that maps computable inputs to low 
outputs. 

Proof. If f <wg, then there are computable functions II,K :C N^' 
such that H{id, GK) is a realizer of / for any realizer G of g. 

1. We prove that if G is computable with at most n mind changes, then 
i?(id, GK) can also be computed with at most n mind changes. Firstly, GK can 
be computed with at most n mind changes just by composing the corresponding 
machines with each other. The machine for K requires no mind change and 
the machine for G at most n mind changes, hence the machine for GK requires 
at most n mind changes. It is straightforward to see that also (id, GK) can 
be computed with at most n mind changes. Now we still have to see that also 
i?(id, GK) can be computed with at most n mind changes. Once again we 
can just compose the machines. In case that the first machine that computes 
(id, GK) performs a mind change and moves the head back on the output tape, 
we can just move the head of the machine for H back into the initial state 
and start the computation of H from scratch. This will happen at most n many 
times and hence the composition can be computed with at most n mind changes. 
One should note that the simulation happens within one single machine where 
the output of the first machine is only simulated and can be revised within 
the simulation as often as required. Therefore, if g has a rc^alizer G that is 
computable with at most n mind changes, then also / has a realizer -ff (id, GK) 
that is computable with at most n mind changes. 

2. If G is a realizer of g such that G{p) is computable for any computable p, 
then -ff (p, GK{p)) is computable for any computable p and hence / has a realizer 
that maps computable inputs to computable outputs. 

3. If G is a realizer of g such that G{p) is low for any computable p, then 
Hip, GK{p)) is low for any computable p, because 

{H^,GK{p)))' <^{GK{p))' <r%' 



for any computable p. 
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We start with applying the Mind Change Principle. It can be used to separate 
LPO and LLPO from all Weihrauch degrees above them that we have considered. 

Proposition 4.5. LPO <w Bp and LLPO <w Br. 

Proof. The positive statements LPO <w Bp and LLPO<vvB|^ have been 
proved in Theorem 13.101 The Mind Change Principle in Lemma 14.41 implies the 
negative statements Bp LPO and B|^ LLPO. 

Obviously, LPO can be computed with one mind change. Given p G dom(LPO), 
a Turing machine can just bet on output 1 and inspect the input until a value 
n with p{n) = is found. In this case the machine has to change its mind 
and revise the output to 0. No further revisions are required, since this is the 
final result. Similarly, LLPO has a realizer that can be computed with one mind 
change. 

It suffices to prove now that Bp and B|~ have no realizers that can be computed 
with at most one mind change. We recall that we can assume that the range of 
Bp is N. Let us assume that M is a Turing machine that computes a realizer 
of Bp with only one mind change. Given a sequence of rational numbers {qi)i£n 
with supjgpj^i = the machine will eventually produce an output n > 0. Until 
this time step the machine has only seen a prefix go, 9n of the input sequence 
{qi)ieK and this sequence can be extended to a sequence go, ■.■,qn,n+l,n+l, ... 
that has supremum n + 1 which is strictly greater than n. Since the machine M 
will start to operate on this new input in the same way, it will have to perform a 
mind change after a while and revise the output to some value fc > n + 1. After 
a certain number of time steps such an output k is produced and once again 
one can modify the input to have a larger supremum than k and this forces the 
machine to make another mind change at a later stage. Thus, the assumption 
that M makes only one mind change is not correct. 

One can prove in a similar way that B|~ has no realizer that can be computed 
with at most one mind change. Let us assume that M is a machine that computes 
a realizer of B|~. Given two sequences {qi)ii£N and (ri)igN of rational numbers 
such that supjgpjgi — a < b = infigN'^i, eventually at a time step t the machine 
M has to produce a result x with a < x < b with precision e < (b—a)/2. Now one 
can modify one of the input sequences to become (g^)igN and (r^)igN such that 
these sequences coincide with ((j'i)ieN and (ri).;^^ on a prefix of length at least 
t, respectively, but such that [x — e,x -\- e) r\ [a', 6'] = 0, where supjgpj q[ = a' < 
b' — infigpjr^. This forces machine M to make a mind change and the process 
can be repeated as above. Thus, B|^ has no realizer that can be computed with 
only one mind change. H 

Now we want to illustrate an application of the Computable Invariance Prin- 
ciple. In particular, it implies that compact choice Ck cannot be reduced to 
interval choice C| and closed choice Ca cannot be reduced to discrete choice Cn- 

Proposition 4.6. C| =w B| <w Ck and Cn <w B|+ <w Ca. 

Proof. The positive statements C| =w B| <w Ck and Cn <w B|+ <w Ca have 
been proved in Theorem 13.101 and Proposition 13.61 The Computable Invari- 
ance Principle in Lemma 14.41 implies the negative statements Ck B| and 
Ca B| + . It is straightforward to see that B| and B|+ have realizers that 
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map computable inputs to computable outputs. This is simply because any non- 
empty interval [a, b] with a left computable a and a right computable b has a 
computable member. This can either be a rational number, if a < 6 or in case 
a = 5 it is a = 5 itself. On the other hand, Ca and Ck do not admit realizers 
that map all computable inputs to computable outputs. This is because there 
are examples such as Kreisel and Lacombe's set K C [0, 1] that is a non-empty 
co-c.e. compact set, which does not contain any computable points (see [34] or 
Theorem 6.3.8.2 in [52]). H 
In order to illustrate an application of the Low Invariance Principle formulated 
in Lemma 14.41 we prove a version of the Low Basis Theorem of Jockusch and 
Soare (see [28] or Theorem V.5.32 in [38]) for real number subsets. Indirectly, it 
is based on the fact that the real numbers are locally compact. 

Theorem 4.7 (Real Low Basis Theorem). Let A CM. be a non-empty co-c.e. 
set. Then there is some point x E A which has a low p-name, i.e. there is a 
p e such that p' <t 0' and p{p) = x. 

Proof. If A C M is non-empty, then there is a rational interval [a, b] such that 
B :— AC\ [a, b] ^ 0. For this interval [a, b] there is a total representation P[a^b\ '■ 
{0,1}'* — * [a, 6] of [a, 6] that is computably equivalent to p restricted to [a, 6]. 
This can be seen as follows. One can just use the signed-digit representation 
P2 ■■ {0, 1, -1}N ^ [-1, 1], defined by 

OO 

P2(p) = Ep(j)2-^-\ 

which is known to be computably equivalent to p restricted to [—1, 1] (see The- 
orem 7.2.5 in [52]) and then one uses some standard computable surjection 
T: {0,l}f«->{0,l,-l}N and 

P[a.b]iP) - \{p2T{p){b~a)+a + b). 

In particular there is a computable function F :C {0, 1}*^ N'*' such that 
P[a.b\{.Q) = pF{q) for all q G {0, 1}'*'. Then C := P^^^{B) is a co-c.e. closed 
subset of Cantor space {0,1}^ since B = A n [a,6] is co-c.e. closed. By the 
classical Low Basis Theorem of Jockusch and Soare any such set has a member 
q G C that is low, i.e. q' <t$'. Now pF{q) = P[a^b]{<l) = x £ A and p = F{q) 
satisfies p <t q and hence p' <t q' <t 0'- Thus p is low too. H 
As a consequence of the Low Basis Theorem and the Low Invariance Principle 
in Lemma 14.41 we obtain that closed choice is S2~computable, but not Sj" 
complete. One can also interpret this such that Countable Closed Choice is not 
reducible to Closed Choice. 

Proposition 4.8 (Incompleteness of closed choice). Ca <w C. 

Proof. The reduction Ca <w C has been proved in Theorem 13.101 We need 
to prove C Ca. To the contrary, let us assume C <-vv Ca- By the Real Low 
Basis Theorem 14.71 there is a realizer F of Ca that selects for any computable 
^/'--name q of some A C M a p-name r = F(q) which is low. Then, by the Low 
Invariance Principle in Lemma 14.41 it follows that C also has a realizer that has 
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a low output for any computable input p. Since C is a function on Baire space, 
this means that C itself has the property that C(p) is low for any computable 
p. But this is a contradiction to Theorem 8.3 in [5], which shows that there is a 
computable p such that C(p) =t 0' and hence not low. H 

Finally, we illustrate how the Baire Category Theorem can be used as a sep- 
aration tool. This is particularly interesting, because, as we will show later, C| 
represents the Intermediate Value Theorem and Cn represents the Baire Cate- 
gory Theorem. Thus, we are using the Baire Category Theorem in order to prove 
that the Baire Category Theorem does not "prove" the Intermediate Value The- 
orem. We denote by n G N'* the constant sequence with value n £ N and we 
use the representation Siq of N, which is defined by Sfi{n) = n for all n E N (and 
undefined for all other inputs). 

Proposition 4.9. C| ^wCn. 

Proof. By Propositions 13.31 and 13.61 it suffices to show B| ^wBp. Without 
loss of generality we assume that /5< -names are strictly increasing sequences 
of rational numbers that converge to the represented point and that /9> -names 
are strictly decreasing converging sequences of rational numbers. As usual, we 
assume that Bp has range N. We mention that the set C := {{p,q) G N'* : 
P<{p) < Pyil)} is co-c.e. closed. We assume that 6 is [p<,p>] restricted to C. 
Let us assume that B| <w Bp. Then there are computable functions H, K such 
that H {id, GK) is a (5, p)-realizer of B| for any (p<, (5N)-realizer G of Bp. We 
can assume that dom{K) = C (otherwise we restrict to C). Now we note that 

P„ {peN"": p<K{p) < n} 

is closed in dom{K) ~ C for all n G N since K is continuous. Moreover, 
US^o — G and by the Baire Category Theorem there must be some n G N 
and some w € N* such that ^ wN'* n C C P„ since C is a complete metric 
space and all the P„ are closed in G. Let us now fix some realizer G of Bp with 
SfiG{p) = max{n, [p<(p)]}. Here [a;] :— minjz G Z : z > x} for any real number 
X G M. It is clear that for this realizer 

P„ = {p G N^* : p<A'(p) <n} = {peN'' : Sj^jGKip) = n}. 

Without loss of generality, we can assume that w is a prefix of a (S-name that 
is long enough to determine some interval [a, 6]. We recall that a name p with 
respect to S = [p<,p>]\c encodes two sequences ((7n)neN and (r„)„gN of rational 
numbers, which are strictly increasing and decreasing, respectively, such that 
sup„gpj (7n < infngN'^n. Hcncc, we assume that w is long enough to determine 
a prefix qo,...,qi with a = maxjgo, g^} and ro,...,ri with b = minjro, r^}. 
In particular, a < b and there is some S-name p with w C p such that / := 
B\S{p) = [a',b'] with a < a' < b' < b. Then x := pH{p,n) G /. Therefore 
X G [a',b') or a; G {a',b']. Suppose for example that x G (a', 6']. Take any open 
interval J such that x £ J and inf(J) > a'. By continuity of pH there is some 
word V with w \Z v ^ p such that pH{vN^ ,n) C J. Without loss of generality, 
V determines some interval [a",b"] (in the same manner as w determines [a, 5]), 
with a < a" < a' < b' < b" < b. It is easy to see that there is some p' with 
w C -y □ p' such that B\5{p') C (a", a']. Therefore B\S{p') n J = 0, and so 
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pH{p',GK{p')) ^ J. But p' G lyNf* and so 5fiGK{p') = n. Furthermore, v ^ p' 
and so pH{p',n) e J, which is a contradiction. The case x e [a', 6') can be 
treated analogously. Figure [5] illustrates the situation. H 



H 
P' 



Figure 5. Intervals generated by v and p' 



Using the previous proposition together with the Parallelization Principle l4.1l 
we obtain that discrete choice Cn and interval choice C| are incomparable. 

Corollary 4.10. Cn|wC|. 

This has a number of negative consequences merely by transitivity, summa- 
rized in the following result. In particular, interval choice is not reducible to 
proper interval choice. 

Corollary 4.11. Ci^wCr andB|+^wCN- 

The contrary assumptions would lead to contradictions to the results above. 
Altogether, we can now strengthen the statement of Theorem 13.101 because all 
the reductions (besides the equivalences, of course) are now known to be strict. 

Corollary 4.12 (Choice hierarchies). We obtain 

1. LLPO<wCr <wC| <wCk=wLLPO<wCa. 

2. LPO<wCn<wB|+<wCa<wC=wLPO. 

3. LLPO <w LPO, Cr <w Cn; C| <w B|+ . 

In particular, all the arrows between the Weihrauch degrees in the diagram in 
Figure[l]that are mentioned here are now proved to be correct and it is clear that 
no additional arrows can be added (besides those that follow by transitivity). 

The reader can verify that negative results can be relativized, if required. For 
instance, the Parallelization Principle 14. II is true in a purely topological version. 
Similarly, the Real Low Basis Theorem 14.71 and other results can be relativized. 

§5. Discrete Choice and the Baire Category Theorem. In this section 
we want to classify the Weihrauch degree of the Baire Category Theorem and 
some core theorems from functional analysis such as the Banach Inverse Map- 
ping Theorem, the Open Mapping Theorem, the Closed Graph Theorem and the 
Uniform Boundedness Theorem. It is clear that these theorems are closely re- 
lated and in fact all these theorems are typically directly derived from the Baire 
Category Theorem or from each other. The computable content of these theo- 
rems has been studied in [3, 4, 6, 9] and we will essentially use results obtained 
in these sources here. 
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We start to discuss the Baire Category Theorem. As explained in the intro- 
duction, it depends on the exact version of the Baire Category Theorem which 
Weihrauch degree the theorem has. If one formahzes the version BCTq, as men- 
tioned in the introduction, then one obtains a fuhy computable theorem (this 
has been proved in [3]) and we will not discuss this version any further here. The 
contrapositive version BCT, however, is interesting for us. 

Definition 5.1 (Baire Category Theorem). Let X he a complete computable 
metric space. We consider the operation 

BCTx :C ^_(X)^ =t N, {Ai)ien ^ {n e N : A. has non-empty interior}, 

where dom(BCTjf) = {(A^^eN : USo^' = 

We note that BCTx is well-defined by the Baire Category Theorem. We 
mention a few facts that are known about BCT (see [3]): 

1. BCTx is discontinuous and hence non-computable. 

2. BCTx is obviously non-uniformly computable in the sense that computable 
inputs are mapped to computable outputs (this is because it has natural 
number output). 

3. BCTx admits a non-computable sequential counterexample. 

There are other possible ways to formalize this theorem. For instance, one 
could consider the space as a part of the input, which would however require the 
discussion of representations of spaces. This approach has been adopted for the 
Hahn-Banach Theorem in [20]. We restrict the discussion here to a fixed space 
X and in this case the result is even stronger, since the Baire Category Theorem 
is equivalent to discrete choice for any fixed non-empty complete computable 
metric space X. 

Theorem 5.2 (Baire Category Theorem). Let X be a non-empty complete com- 
putable metric space. Then BCTx=wCn- 

Proof. We prove BCTx<swCn- Given a sequence (v4i),igN of closed sets 
with X ~ Ui^o want to find some n such that A„ has non-empty interior. 

Let (i3i)igN be an effective enumeration of the open rational balls of X. The set 

P = {(n,m) e N : (X \ A„) n B,„ ^ or = 0} 

is c.e. in and hence we can compute a p G N'* such that range(p) — 1 = P. Then 
P = N \ Q with 

and by the Baire Category Theorem this set is non-empty. Hence, using a realizer 
of Cm, we can determine a point (n, m) e Q = N \ P and the component n is the 
desired result. This proves BCTx <sW Cm- 

In order to prove Cn <w BCTx, it suffices to prove Bp <w BCTx by Proposi- 
tion [3l3l Given a sequence of rational numbers (gi)igN which is bounded from 
above, we want to compute some upper bound n S N with x :— supj^pj^i < n. 
Given (gi)igN we can compute a sequence (A„)„gN of closed sets with 

^ r if (3i) n<q, 
" ' \ X otherwise 
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for all n G N. Then IJ^q An — X and any n such that An has non-empty 
interior satisfies x < n. Such an n can be determined with a realizer of BCTx 
and hence Cn <w Bp <w BCTjf. H 
We mention that a seemingly different versions of the Baire Category Theorem 
are in fact equivalent to BCTx as the same proof above shows: 

1. Together with the index n of a set An that has non-empty interior we can 
even determine an index m of a non-empty ball Bm Q An ■ This is what is 
required in practice when the Baire Category Theorem is applied. 

2. The Baire Category Theorem could be restricted to monotone sequences 
(A„)„gN, i-e. sequences such that An Q An+i for all n E N. 

As a next theorem we discuss the Banach Inverse Mapping Theorem. If X and Y 
are computable metric spaces with Cauchy representations Sx and Sy, respec- 
tively, then we denote by C{X,Y) the set of (relatively) continuous functions 
T . X Y and we represent C{X,Y) by the canonical function space repre- 
sentation [Sx 6y] (see [52]). A computable Banach space is just a normed 
space together with a sequence whose linear span is dense in the space and such 
that the induced metric space is a complete computable metric space (see [9] 
for details). The Banach Inverse Mapping Theorem can even be described by a 
single-valued function in a very natural way. It is just the inversion operator. 

Definition 5.3 (Banach Inverse Mapping Theorem). LetX,Y be computable 
Banach spaces. Then we define 

\MTx.Y :C C{X,Y) C{Y, X),T >^ T''^ 

with dom(IMTx,y) {T G C{X,Y) : T linear and bijective}. 

We note that IMTx,y is well-defined by the Banach Inverse Mapping Theorem. 
We briefly note what is known about IMTj^^y (see [9]): 

1. IMTx,Y is discontinuous and hence non-computable in general. 

2. IMTx,Y is non-uniformly computable, i.e. the inverse of any com- 
putable linear and bijective operator T : AT — > F is computable. 

3. I MTx,Y admits a non-computable sequential counterexample for the Hilbert 
space X = Y — £2- 

4. IMTx,y is computable for finite-dimensional X,Y. 

This means, in particular, that unlike the situation with the Baire Category 
Theorem it is the case that the Weihrauch degree of the Banach Inverse Mapping 
Theorem depends on the underlying spaces. The worst case, however, is already 
achieved for the computable infinite-dimensional Hilbert space X — Y = £2- 

Theorem 5.4 (Banach Inverse Mapping Theorem). Let X,Y be computable 
Banach spaces. Then IMTx.y <vv Cn =w ^^'^12,12- 

Proof. By Proposition 13.31 it is sufficient to prove the claim for Bp instead 
of Cn- We prove IMTx.y <w Bp. In Theorem 4.9 of [9] it has been proved that 
the map 

L :C C(A, r) X M ^ C{Y, A), (T, s) ^ T'^ 

with dom(t) — {(T, s) : T linear and bijective and ||r^^|| < s} is computable. 
On the other hand, it is clear that | | ~ l/(inf||^||=i | |ra;| |) (see Exercise 5.14 
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in [49]) and a /9<-nanie of this number can be computed, for a given T. Thus, 
given a reahzer of Bp, we can actually compute an upper bound of HT""^!! and 
together with the input T, we can compute using t. 

Now we assume that X = Y = £2 and we prove Bp <w IMT^^^^^. In Proposi- 
tion 4.7 of [9] it has been proved that there is a computable operation r :C R> ^ 
C(^2,^2) such that for any a G IR> with a G (0, 1] there exists some G r(a) 
and all suchT^ : £2 ^ f-2 arc linear, bounded, bijective and satisfy ||T~^|| = 1/a. 
Thus, given some x £ M< that without loss of generality satisfies a; > 1, we can 
compute some Ti/^ S t{1/x) and using some realizer of \MTe^/^ we obtain T^^K 

This allows to compute some upper bound M > = a; by Theorem 5.1 of 

[6]. Hence Bp<wlMT<>,_£,. H 

Roughly speaking, the Banach Inverse Mapping Theorem is almost computable. 
The only extra information that cannot be extracted from the given operator T 
is the norm of its inverse. In fact, the norm can be computed from below 

and one upper bound suffices as extra information to obtain the inverse. It is 
exactly this upper bound that can be provided by Bp =w C^. Vice versa, on £2 
the inverse operator can be used to compute such upper bounds. This situation 
is practically the same for the Open Mapping Theorem. 

Definition 5.5 (Open Mapping Theorem). Let X,Y be computable Banach 

spaces. Then we define 

OMTx.y :C C{X, Y) C{0{X),0{Y)),T ^ {U ^ T{U)) 
with dom(OMTx,y) := {T G C{X^Y) : T linear and surjective}. 

The operation OMTx.y is well-defined by the classical Open Mapping Theo- 
rem. Here 0{Z) denotes the set of open subsets U C Z and it is represented 
with the positive information representation i?. That is, a name of an open set 
U is & list of rational open balls B{xi, r^) whose union is U (see [13] for details). 
We just mention the result without proof here (the reader can find all required 
ingredients for the proof in [9]). 

Theorem 5.6 (Open Mapping Theorem). LetX,Y be computable Banach spa- 
ces. Then OMTx.y <w Cm OMTi^^ i^ . 

Another interesting theorem is the Closed Graph Theorem. The classical 
theorem states that a linear operator with a closed graph on Banach spaces is 
bounded. We can eflFectivize this result using positive information on the graph. 

Definition 5.7 (Closed Graph Theorem). LetX,Y be computable Banach spa- 
ces. Then we define 

CGTx.Y :C A+{X xY)^ C{X, F), graph(r) T 

where dom(CGTjf_y) contains all those closed subsets A C X xY for which there 
is a linear bounded T : X ^Y such that A = graph(T) . 

Here A+{Z) denotes the set of closed subsets of Z equipped with the positive 
information representation 7,6+ • A name of a closed set A C. Z in this sense is a 
list of all rational open balls which intersect A. 
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Theorem 5.8 (Closed Graph Theorem). Let X, Y be computable Banach spa- 
ces. Then CGTxx — w Cn =w CGT^j^^j . 

Proof. By Proposition 13.31 it is sufRcient to prove the claim for Bp instead 
of Cpj. By Theorem 4.3(2) in [4] the representation [Sx Sy] of linear bounded 
operators T : X Y is equivalent to the representation that represents T by 
positive information on graph(T) and an upper bound on the operator norm | |T| |. 
Having positive information on graph(T) allows to compute a dense sequence 
within graph(T) and hence lower bounds of With the help of Bp one can 

obtain the required upper bound. This proves CGTx,y <w Bp 

Now let X = Y = £2- We use Example 5.3 of [6]. Given a real number 
a e R< by a sequence (ai)igN of rational numbers with supj^pj — a, we compute 
positive information on graph(T) of the operator T : £2 —> (-2 with T{xi)i^fi 
{aiXiji^n. Using a realizer of CQT x,y we obtain the operator T and hence we 
can compute some upper bound M > ||r|| = a by Theorem 5.1 of [6]. Hence 
M e Bp (a), which proves Bp <vv CGTf2,f2- ~^ 

Analogously to the Banach Inverse Mapping Theorem and the Open Mapping 
Theorem it is known that the Closed Graph Theorem is computable for finite- 
dimensional X, Y . 

As a final example in this section we discuss the Uniform Boundedness The- 
orem. In case of the Uniform Boundedness Theorem the relation to Bp is even 
more visible that for the other results, since the statement of the theorem is that 
certain upper bounds exist. We formalize the theorem as follows. 

Definition 5.9 (Uniform Boundedness Theorem). Let X,Y be a computable 
Banach spaces. Then we define 

UBTx.y :C C{X,Yf ^ N, (T,),^^ {Af G N : sup.gp, < M} 

where dom(UBTx,y) contains all sequences (Tj)jgp} of linear and bounded oper- 
ators Ti : X —>■ Y such that {||Tia;|| : i G N} is bounded for each x G X . 

It follows from the classical Uniform Boundedness Theorem that the operation 
UBTx,y is well-defined. Now we can prove the following equivalence. We men- 
tion that similarly as for the Baire Category Theorem it turns out that we obtain 
the worst case for the Uniform Boundedness Theorem for arbitrary computable 
Banach spaces X ^ {0}. 

Theorem 5.10 (Uniform Boundedness Theorem). LetX,Y be computable Ba- 
nach spaces different from {0}. Then UBTj^ y- =w Cn- 

Proof. By Proposition 13.31 it is sufRcient to prove the claim for Bp instead 
of Cpf. In Corollary 5.5 of [6] it has been proved that the uniform bound map 

U :C C{X,Y f ^ R<, (T,),eN ^ sup.gN ||r,|| 

is computable with dom(?7) — dom(UBTx,y). This directly implies the reduc- 
tion UBTx.Y <w Bp and hence we obtain UBT^.y <w Cn with Proposition 13. 31 
Now we prove Bp <w UBTx,Y: using Remark 5.7 of [6]. Given a real number 
a G R< by a sequence (ai)^^^ of rational numbers with supjgjj = a, we compute 
a sequence of operators Ti : X Y such that Tie := aic' for some computable 
unit-length vectors e G X and e' £ Y and TiX :— for &\\ x G X that are 
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linearly independent of e. Then \\Ti\\ = for all ?' £ N and {||rja;|| : i S N} 
is bounded for each x & X. Now using a realizer of UBTx,y an upper bound 
M e UBTx,r((Ii)ieN) of supjgpj ||Ti|| = a can be determined. Hence M G Bf{a), 
which proves Bp <w UBT^.y. H 
Although classically the Banach Inverse Mapping Theorem, the Open Mapping 
Theorem, the Closed Graph Theorem and the Uniform Boundedness Theorem 
can be proved with the Baire Category Theorem, we have not exploited any 
logical relation between these theorems here, but just the fact that they have 
the same computational power. A common feature of all the theorems discussed 
in this section that are equivalent to Cn are: 

1. They arc discontinuous and hence non-computable (since Cn is so). 

2. They admit non-uniform computable solutions (since Cn has a realizer that 
maps computable inputs to computable outputs). 

3. They have A^-complete sequential counterexamples (since =w C, any 
realizer maps some computable sequence to some Aj-complete sequence in 
the arithmetical hierarchy). 

All the properties mentioned here are degree theoretic properties and any theo- 
rem equivalent to Cn will be of the same category. In [3], for instance, it required 
an explicit construction using a simple set to show that the Baire Category The- 
orem BCT has a non-computable sequential counterexample. Now such results 
can be easily derived from the characterization presented here. In particular, all 
properties of BCTx and IMTx,y mentioned in the beginning follow immediately 
from the classification of the Weihrauch degree of the corresponding theorems, 
except the observation 4. that \MTx,y is computable for finite-dimensional X, Y. 

§6. Interval Choice and the Intermediate Value Theorem. In this 

section we want to study the Intermediate Value Theorem. In the following 
definition we specify the multi- valued operation which captures this theorem. 

Definition 6.1 (Intermediate Value Theorem). We define a multi-valued op- 
eration IVT :C C[0, 1] =r [0, 1] by 

IVT(/) := {a;e[0,l]:/(a;) = 0} 

and dom(IVT) := {/ e C[0, 1] : /(O) ■ /(I) < 0}. 

This theorem has been carefully analyzed in computable analysis (see Sec- 
tion 6.3 in [52]) and the main results are: 

1. IVT is discontinuous and hence non-computable. 

2. IVT is non-uniformly computable in the sense that IVT(/) contains a com- 
putable point for any computable / G dom(IVT). 

3. IVT is a computable single-valued function restricted to functions with a 
unique zero. 

4. IVT restricted to the set of functions with nowhere dense zero set is com- 
putable. 

The first three properties of the Intermediate Value Theorem are actually 
immediate consequences of the following classification of its Weihrauch degree. 
We prove that the Intermediate Value Theorem is equivalent to Interval Choice. 
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The last mentioned observation 4. requires an analysis of the Intermediate Value 
Theorem that goes beyond classifying its Weihrauch degree (it can be proved 
with the so-called trisection method, a computable variant of bisection). 

Theorem 6.2 (Intermediate Value Theorem). IVT=sw C|. 

Proof. By Proposition 13 .61 and Lemma [5751 it is sufficient to prove the reduc- 
tions B|' <svv IVT <sw B|. First we show IVT <sw B|. Given a function / G C[0, 1] 
with /(O) • /(I) < we want to find a zero, i.e. a point x E [0, 1] with f{x) — 0. 
We determine two sequences of rational numbers ((7n)neN and (r„)„gN as follows. 
We let qq := 0, tq := 1. In step n + 1 of the computation we assume that all 
the values up to (?„ and r„ are given and then we perform an exhaustive search 
over all possible pairs (g„+i, r„_|-i) of rational numbers for at most n time steps 
in order to identify the pair with the smallest difference \qn+i — fn+i\ that we 
can find and such that 

g« < qn+i < Tn+i < r„ and /(g„+i) • /(r-n+i) < 0. 

If we cannot find such (7„_|_i,r„+i in n time steps, then we let qn+i = In and 
r„+i — rn- It is clear that in this way we obtain y := sup„gpjg„ and z := 
inf„gNr„ with [y,z] C /^^{O} and any realizer of B| can determine a zero x € 
B|(2/,z) of/. 

Now we prove B|' <sW IVT. Given a strictly increasing sequence {qn)neri and a 
strictly decreasing sequence (r„)„gN of rational numbers with y := sup„gpj(7„ < 
inf„gN''n ■— z we want to find a number x with y < x < z. Without loss of 
generality we can assume that qo > and ro < 1. Now we compute a sequence 
of rational polygons {fn)neN as follows. The function /„ is the polygon with the 
following vertices: 

(0, -1), (go, -2-1), (qi, -2-2), {q„, -2-"-i), 
(r„,2-"-i),(r„_i,2-"),...,(ro,2-i),(l,l). 

Figure [H] illustrates the situation. Then {fn)neN is a sequence that converges 
effectively to a continuous function / with /(O) • /(I) < and /-^{O} = [y,z]. 
Thus, any realizer of IVT can determine a value x £ IVT(/) with y < x < z. H 

We list some common features of all theorems that are equivalent to C|. We 
note that by Corollary 12.111 any uniquely determined solution is already uni- 
formly computable in the input. 

1. They are discontinuous and hence non-computable (since C| is so). 

2. They admit non-uniform computable solutions (since C| has a realizer that 
maps computable inputs to computable outputs). 

3. They are uniformly computable under all classical conditions where the 
solution is uniquely determined (since C| is weakly computable). 

4. They have limit computable sequential counterexamples (since C| =w WKL). 

5. They have sequential solutions of any basis type (since C| =w WKL). 

By a basis type we mean any set B C that forms a basis for II" subsets of 
Cantor space {0, 1}^ (see [17]), such as the set of low points. The fact 4. means 
for the Intermediate Value Theorem that there exists a computable sequence 
(/n)neN of continuous functions /„ : [0, 1] ^ M with /„(0) • /n(l) < such that 
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Figure 6. Polygon /a 

any sequence (a;„)„gN of reals with /„(a;„) = is non-computable. A direct 
proof of this fact by itself requires almost two pages (see Example 8a by Pour- El 
and Richards in [40]), whereas here it is a simple corollary of the classification 
of the degree of the Intermediate Value Theorem. 

As an observation aside we characterize the image of the set of computable 
functions under IVT, i.e. the class of zero sets of computable functions that 
change their sign. We recall that the co-c.e. closed sets A C [0, 1] are exactly 
those for which there exists a computable function / : [0, 1] ^ M with /~^{0} = 
A (see [14, 52]). Somewhat surprisingly, we can attach an arbitrary computable 
point to an arbitrary co-c.e. closed set to obtain one that appears as a zero set 
of a function with changing sign. 

Proposition 6.3. Let A C (0, l) be a non-empty set. Then the following are 
equivalent: 

1. A = f-^{0} for some computable / : [0, 1] ^ K with /(O) • /(I) < 0. 

2. A = B U {x} for some set B C (0, 1) that is co-c.e. closed in [0, 1] and for 
some computable point x G (0, 1). 

3. A is co-c.e. closed in [0, 1] and contains a computable point x G (0, 1). 

Proof. We show that 1. implies 3. It is clear that any set A — f^^{0} 
is co-c.e. closed and it follows from the previous Theorem 16.21 that A contains 
a computable point considering IVT =w B2 (as mentioned above, this is well- 
known, see [52]). It is clear that 3. implies 2. We show that 2. implies 1. Now 
let B C (0, 1) be co-c.e. closed in [0, 1] and let x G (0, 1) be computable and let 
A = B U {x}. Then there exists a computable function 17 : [0, 1] ^ M such that 
g^^{0} = B. Without loss of generality we can assume g{0) > and g{l) > 0, 
since we can replace g by \g\ otherwise. Now we define h{y) := y — x for all 
y € [0, 1] and f := g ■ h and we get a computable function / with 

/"^{O} = 9'^{0} U h-^{0} = BU{x}=A 



and /(O) • /(I) - /i(0) • /i(l) < 0. M 
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§7. Compact Choice and the Hahn-Banach Theorem. The Hahn-Banach 
Theorem has been studied in detail in [8] and [20], see also [12]. We just briefly 
summarize the known results, without formalizing the corresponding multi- 
valued function HBT here: 

1. HBT is discontinuous and hence non-computable. 

2. HBT is computable under all classical conditions that guarantee unique 
existence of the solution, such as uniform convexity of the dual space, which 
holds for instance for Hilbert spaces. 

3. HBT is not non-uniformly computable in general, not even for finite-dimensional 
spaces. 

The following theorem follows essentially from results in [20], see also [12]. 
The formalization chosen for this result includes the underlying space as a part 
of the input data. 

Theorem 7.1 (Hahn-Banach Theorem) . HBT=wCk. 

Common features of all theorems equivalent to Ck are: 

1. They are discontinuous and hence non-computable (since Ck is so). 

2. They are uniformly computable under all classical conditions where the 
solution is uniquely determined (since Ck is weakly computable). 

3. They have non-uniform solutions of any basis type (since we have that 
Ck^wWKL). 

4. They have limit computable counterexamples (since we have that Ck =w WKL). 

§8. Metatheorems and Applications. In this section we want to discuss a 
number of metatheorems that allow some conclusions on the status of theorems 
merely regarding the logical form of these theorems. Essentially, we are trying 
to identify the computational status of n2-theorems, i.e. theorems of the form 

{yxGX){3y€Y) {x,y)€A, 

where depending on the properties of Y and A automatically certain computable 
versions of realizers of these theorems exist. In many cases this allows to get some 
upper bound on the Weihrauch degree of the corresponding theorem straightfor- 
wardly. We will discuss these metatheorems together with some characteristic 
examples. Before we formulate the first metatheorem, we briefly mention open 
choice. 

Definition 8.1 (Open choice). Let X be a computable metric space. The 
multi-valued operation 

Co{x) :CO{X)^X,U^U 

with dom(Ce)(x)) := {U C X : U ^ <l) open} is called open choice of X. 

It is clear that open choice is computable, since any non-empty ball B{xi, ri) 
already provides a point in the set, namely its center Xi. 

Corollary 8.2 (Open choice). Let X he a computable metric space. Then 
^o(x) '■'^ ^{^) ^ X is computable. 
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This directly implies the following result, which is nothing but a well-known 
uniforniization property. We include it here in order to emphasize the analogy 
to the following metatheorems. 

Theorem 8.3 (Open Metatheorem). Let X,Y be computable metric spaces 
and let U X X Y be c.e. open. If 

then R : X ^ Y, X i-^ {y E Y : {x,y) Cz U} is computable. 

Proof. We consider the section map 

S:X^ OiY),x^ U^:={yeY: {x,y) € U}. 

We use the fact (see [13]) that the representation d of 0{X) is computably 
equivalent to the representation t?', defined by 

^'{p) = U:^ [Sx^p]{p) = f and /-^{O} = X\U. 

Since U C X x Y is c.e. open, there is a computable function f : X x Y ^ M. 
such that {X X Y) \ U = /~^{0} and by type conversion one obtains that the 
function 

g:X ^C{Y,R),x^iy^ fix.y)) 

is computable as well. However, {g{x))^^ {0} = Y\Ux and hence S is computable. 
Thus R = Co{Y) ° S is computable by Corollarv l8.2l H 
An example of a theorem that falls under this category is the Weierstrafi 
Approximation Theorem. It can be formulated as 

(V/eC[0,l])(VfceN)(3neN) ||/-p„|| <2-^ 

where (pn)neN is some effective enumeration of the rational polynomials Q[x]. 
The predicate 

U := {if,k,n) : \\f - Pn\\ < 2-'-} C C[0, 1] x N x N 

is c.e. open. Hence, given a continuous function / : [0, 1] — > M and fc e N we 
can actually effectively find a rational polynomial p„ that approximates / with 
precision 2^''. If we denote by WAT : C[0, 1] x N ^ N the corresponding realizer 
of the Weierstrafi Approximation Theorem, then we get the following corollary. 

Corollary 8.4 (Weierstrafi Approximation Theorem). WAT=wid. 

Of course, this theorem as such is well-known. It has been proved directly, 
for instance, by Caldwell and Pour-El [16] and Hauck [21]. There are many 
other approximation results that fall into the same category as the Weierstrafi 
Approximation Theorem. Roughly speaking, if one has a H2-statement with 
a classical proof such that the corresponding predicate is c.e. open, then one 
automatically has a computable version of the theorem. The next metatheorem 
is a similar observation for co-c.e. closed predicates and co-c.e. compact Y. We 
first formulate a lemma. 

Lemma 8.5 (Section). Let X,Y be computable metric spaces. Then 

sec : A-{X xY)x X ^ A-{Y),{A,x) ^A^-.^iyeY: {x,y) e A} 

is computable. 
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The proof is straightforward and can be found in Lemma 6.2 of [8]. As a 
consequence we obtain the fohowing resuh. 

Theorem 8.6 (Compact Metatheorem) . LetX^Y be computable metric spaces 
and let Y be co-c.e. compact and A (- X x Y co-c.e. closed. If 

{yxeX)i3yeY){x,ij)eA, 

then R : X ^ Y, X i—> {y £ Y : (x,y) A} is weakly computable, i.e. R <w Ck- 

Proof. Because Y is co-c.e. compact, the identity id : A-{Y) — > /C_(F) is 
computable (see Lemma 6 in [7]). According to the Section Lemma [5751 it follows 
that the map 

S -.X ^ IC-{Y),x^ A^ 

is computable, because A C X x Y is co-c.e. closed. Thus R = C^(y) o 5' is 
weakly computable by Theorem l2.10l H 

In other words, R <w Ck under the given conditions. An example of a theorem 
that falls under this category is the Brouwer Fixed Point Theorem which states 

(V/ e C([0, 1]", [0, l]"))(3x G [0, 1]") fix) = X. 

The space [0, 1]" is computably compact and the predicate 

A = {(/, x) : fix) =x}C C([0, 1]", [0, 1]")) X [0, 1]" 

is co-c.e. closed. Hence there is a weakly computable solution for the Brouwer 
Fixed Point Theorem. If we denote by BFT : C([0, 1]", [0, 1]")) ^ [0,1]" the 
corresponding realizcr of the Brouwer Fixed Point Theorem, then we get the 
following corollary. 

Corollary 8.7 (Brouwer Fixed Point Theorem). BFT<wWKL. 

Having such an upper bound allows immediately to draw a lot of conclusions. 
From the Low Basis Theorem of Jockusch and Soare and the Low Invariance 
Principle 14.41 we get for instance the following conclusion. 

Corollary 8.8. Let f : [0, 1]" [0, 1]" be a computable function. Then f 
has some low fixed point x G [0,1]", i.e. fix) = x and x has some low name 
p G N'*' such that pip) = x. 

Many other theorems of analysis that have to do with the solution of equations 
in compact spaces fall into the same category. This applies for instance to the 
Schauder Fixed Point Theorem and also to the Intermediate Value Theorem. 
Sometimes it is not immediately clear that a theorem is of this form. In case of 
the Peano Existence Theorem for solutions of initial value problems of ordinary 
differential equations it is easy to see that it can be reduced to the Schauder 
Fixed Point Theorem (see [48]). Another example of this type is the Hahn- 
Banach Theorem. As it is usually formulated, is not of the form of an equation 
with a solution in a compact space. However, using the Banach-Alaogiu The- 
orem, it can be brought into this form (see [7, 20]). Whenever a theorem that 
falls under the Compact Metatheorem has a unique solution, then that solution 
is automatically uniformly computable in the input. That follows from the Com- 
pact Metatheorem 18.61 and Corollary I2.11[ which states that any single- valued 
weakly computable function is computable. 
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Corollary 8.9 (Unique Compact Metatheorem) . LetX,Y be computable met- 
ric spaces. Let Y be co-c.e. compact and let A C X x Y he co-c.e. closed. If 

{yxeX)i3lyeY){x,y)eA, 

then R : X ^ Y.x i—> {y gY : (x,y) E A} is computable. 

Thus, under all (perhaps purely classical) conditions under which the Brouwer 
Fixed Point Theorem, the Intermediate Valued Theorem, the Hahn-Banach The- 
orem or the Pcano Existence Theorem have unique solutions, they are already 
automatically fully computable. Finally, we want to prove a locally compact 
version of our metatheorem. As a preparation we first define a generalization of 
closed choice. 

Definition 8.10 (Closed choice). Let X be a computable metric space. The 
multi-valued operation 

CAix) ■.CA-{X)^X,A^A 
with dom(C_4(x)) :~ {A <Z X : A^ % closed} is called closed choice of X . 

In general closed choice is much less well-behaved than compact choice. It 
is known, for instance by a result of Kleene, that there are co-c.e. closed sets 
A C that have no hyperarithmetical points (see [29] and Theorem 1.7.1 in 
[17]). A relativization of that result leads to the following conclusion. 

Corollary 8.11. C_4(r^N) :C y^_(N^) =^ N*** has no Borel measurable realizer. 

On the other hand, we know that C_4({g j^jn) =w Ck <w Ca = ^acsl) by Corol- 
lary [ITT^ and Theorem l2 . 1 01 and C_4(r) is Sj-computable (but not Sj^complete). 
Thus, the Weihrauch degree of ^a{x) sensitively depends on X. However, if the 
computable metric space X is effectively locally compact, then we can say at 
least something. We recall that X is effectively locally compact^ if there is an op- 
eration that computes for any point x £ X and any rational open neighbourhood 
/ of a; some compact set K with full K-information such that x € K° C K C I 
(see [10] for details). In Proposition 4.5 of [10] it has been proved that for effec- 
tively locally compact X the identity id : A-{X) A+{X) is limit computable 
(i.e. Sj-computable). Since any effectively locally compact metric space X is 
complete, positive information on non-empty closed sets allows to select a point 
(see [13]). We obtain the following corollary. 

Corollary 8.12 (Closed Choice). Let X be an effectively locally compact com- 
putable metric space. Then C_4(x) <w C. 

This corollary allows us to prove the following locally compact version of our 
Metatheorem. 

Theorem 8.13 (Locally Compact Metatheorem). Let X,Y be computable met- 
ric spaces, let Y be effectively locally compact and let A <Z X xY be co-c.e. closed. 
If 

(Vx e X){3y e Y){x,y) e A, 

then R : X ^ Y, X t-^ {y G Y : {x,y) G A} satisfies R <w Ca{y) ■ I""^ particular, 
R is limit computable. 
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Proof. According to the Section Lemma [531 the map 

S -.X ^ A-iY),x^ 

is computable with respect to because A C X x Y is co-c.e. closed. Ac- 
cording to Corollary 18.121 the closed choice C_4(y) is limit computable because 
Y is effectively locally compact. Thus R — C_4(y) o S <w (^a{y) and R is limit 
computable too. M 
We illustrate an application of the Locally Compact Metatheorem. 

Corollary 8.14. Let X be a computable metric space and let Y be an effec- 
tively locally compact metric space. If f : X ^ Y is a function with a co-c.e. 
closed graph graph(/) = {{x, y) E X xY : f{x) — y}, then f is limit computable. 
In particular, the inverse : X ^ Y of any computable bijective function 
g : Y ^ X is limit computable. 

One can even say more in this case. The function f\K restricted to any compact 
K C X is computable (see Proposition 7.2 in [8]) and hence / maps computable 
points to computable points. We now get a corresponding uniqueness version of 
the Locally Compact Metatheorem as a corollary. 

Corollary 8.15 (Unique Locally Compact Metatheorem). LetX,Y be com- 
putable metric spaces, let Y be effectively locally compact and let A C X x Y be 
co-c.e. closed. If 

(yxeX)i3\yeY){x,y)eA, 

then R : X Y, X t—^ {y ^ Y : {x,y) G A} satisfies R <w ^A{Y) ■ ^'^ particular, 
R is limit computable and maps computable inputs to computable outputs. The 
function R\ii restricted to compact sets K Q X is computable. 

§9. Conclusions. In this paper we have suggested a new approach to classify 
mathematical theorems according to their computational content just by using 
methods of topology and computability theory. It is obvious that this approach 
is closely related to other classifications of more proof theoretic nature that exist 
in constructive and reverse mathematics. We cannot provide any exhaustive 
analysis of the similarities and differences between our results and known results, 
but we briefly summarize some observations. 

9.1. Constructive mathematics. Based on the work of Bishop and Bridges 
[1, 15] Ishihara has classified many theorems in constructive analysis with respect 
to their relation to certain non-constructive principles, in particular, with respect 
to LPO and LLPO, see the survey [25]. Equivalence of theorems in this approach 
essentially means intuitionistical equivalence in a setting where certain choice 
axioms such as countable choice, dependent choice and unique choice are ac- 
cepted. It turns out that in this setting the following theorems are equivalent to 
LLPO: 

1. Weak Konig's Lemma [24]. 

2. The Intermediate Value Theorem [15]. 

3. The Hahn-Banach Theorem [24]. 

4. Some form of the Heine-Borel Theorem [24]. 
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One of the several differences to our classifications is that the Hcine-Borel 
Theorem is fully computable in our approach [52]. This is essentially because 
we do not have to prove existence of finite subcovers, but we can just search for 
them systematically (which is also impossible in constructive analysis without 
Markov's principle). 

Moreover, it is clear that there is no distinction between LLPO and its par- 
allelization LLPO in constructive analysis, since the parallel and even the se- 
quential application of LLPO is allowed in the logical framework of constructive 
analysis. The sequential application of LLPO does not lead to any more difficult 
operations, since the class is closed under composition (see [20] and [12]). 

This is different for LPO, since LPO is known to be S2~complete (sec [5]) it 
follows that the iterations of this operation climb up the finite part of the Borel 
hierarchy. This is why equivalence to LPO in the framework of constructive anal- 
ysis is a much wider concept and even includes the Bolzano- WcierstraB Theorem 
[25, 35], which is not below LPO in our framework (this will be shown elsewhere). 

Other differences between constructive analysis and our approach are that we 
cannot distinguish between LPO and its weaker version WLPO, since both prin- 
ciples are equivalent in our approach and indeed their realizations have the same 
degree of discontinuity. Principles like Markov's principle MP are continuous 
and computable from our perspective. 

Other weaker principles of omniscience such as LLPO„ that have been intro- 
duced in constructive analysis by Richman [41, 42] have, however, been inten- 
sively studied in computable analysis [51, 36] and they seem to be useful for the 
classification of problems of more combinatorial nature. 

Finally, we mention that our uniqueness results for weakly computable func- 
tions arc reminiscent of the study of uniqueness questions in constructive analysis 
by Schuster, see [45, 46] and our metatheorems are perhaps related to those of 
Gelfond, see [18]. 

9.2. Reverse mathematics. In reverse mathematics as proposed by Fried- 
man and Simpson [48] theorems are classified according to which comprehension 
axioms are required to prove the corresponding theorems in second order arith- 
metic. Almost all theorems that we have considered have also been classified 
in reverse mathematics. For instance the following theorems are known to be 
provable in the base system RCAq with recursive comprehension (see [48]): 

1. The Baire Category Theorem. 

2. The Intermediate Value Theorem. 

3. The Uniform Boundedness Theorem. 

There are many theorems provable in the base system that are uniformly 
computable in our approach, such as the Tietze Extension Theorem [53] and we 
do not list them there. In case of the Baire Category Theorem the actual proof 
provided in [48] is a proof of the constructive and computable version BCTq. 
But since reverse mathematics is based on classical logic this statement can 
be freely converted into the non-computable and non-constructive version BCT. 
Correspondingly, all theorems that are derivable from BCT are also provable in 
RCAq. Roughly speaking, the base system RCAq corresponds to our non- uniform 
computability results. 
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The second most important system in reverse mathematics is WKLq and it 
roughly corresponds to our class of weakly computable operations (operations 
that are Weihrauch reducible to WKL). This class includes the Hahn-Banach 
Theorem and, of course, Weak Konig's Lemma itself [48]. Similarly to construc- 
tive mathematics (see above) we find that the Heine-Borel Theorem is a distin- 
guishing feature, as it is computable in our system. Finally, the system ACAq 
of arithmetic comprehension corresponds to our class of effectively Borel mea- 
surable maps and in contrast to our system composition of operations is always 
for free like in constructive mathematics which makes it difficult to distinguish 
different levels of the Borel hierarchy in reverse mathematics. In contrast to 
constructive mathematics, however, parallelization does not seem to be for free 
in reverse mathematics. The relation between computable analysis and reverse 
mathematics has first been studied in [20]. 

Kohlenbach has suggested a uniform version of reverse mathematics [32, 33, 
44]. Although the uniform formulations of the studied principles such as Weak 
Konig's Lemma seem to be very closely related to our rcalizcr interpretations, the 
results are considerably different. For instance, it seems that the analogue (3^) 
of LPO is equivalent to the uniform version of Weak Konig's Lemma, whereas in 
our approach these two principles are even incomparable. 

Moreover, we mention that there could be a relation between known conser- 
vativeness results of WKLq in reverse mathematics [47] and the fact that single- 
valued weakly c;oniputablc function are computable in our setting. 

Finally, we note that there is the approach of limit computable mathematics 
proposed by Hayashi and studied by several others. Also in this context a close 
relation between WKL and LLPO has been established [37, 22]. 

The observations collected here lead to plenty of fascinating questions for 
further research. In any case, we believe that our computational classification 
of theorems contributes new insights and yields a finer classification of theorems 
in some respects. To understand the exact relation between our approach, the 
intuitionistic approach in constructive analysis and the more proof theoretic 
analysis in reverse mathematics requires further studies. 
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